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(54) Apparatus for transforming a digital color image signal. 



(57) This invention minimizes the visibility of 
quantization artifacts associated with multi- 
dimensional color-cafibration look-up tables 
(46) of a limited size. Such artifacts occur when it 
is not practical to use interpolation methods to 
approximate color values which are inter- 
mediate to the color values stored in the look- 
up table. In such cases the input color signals are 
simply quantized for the purpose of addressing 
the look-up table. This invention works by ap- 
plying (42) local mean preserving spatial modu- 
lation e.g. a periodic dither pattern, to the input 
color image values prior to the quantization 
step (44). In another embodiment the quanti- 
zation error Is diffused to nearly unprocessed 
pixels. As with multilevel halftoning techni- 
ques, the result is that the appearance of inter- 
mediate color values is created because the 
observer will spatially average the output color 
values. 
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Field of the Invention 

The present invention relates to the field of digital 
color imaging systems, and more specifically to a 
process of performing color-calibration and/or color 
space transformations so as to minimize color errors 
and contouring. 

BACKGROUND OF THE INVENTION 

In a digital color imaging system, a color image is 
represented as a set of color picture elements ("pix- 
els"). Each pixel has associated with it a set of color 
values which describe the color (hue, saturation and 
lightness) for that position in the image. The color val- 
ues correspond to the color coordinates in some given 
color space. There are many different color spaces 
(e.g. RGB, CIE tristimulus (XYZ), CIELAB, CIELUV, 
CMY(K), etc.) which are commonly used. Some color 
spaces, such as XYZ, CIELAB, and CIELUV are de- 
vice independent and will therefore give an absolute 
measure of the color for each pixel in the image. Oth- 
ers, such as RGB and CMY(K), are device dependent 
and can only be related to an absolute color value if 
the spectral characteristics of a specific device are 
known. 

For many applications it may be necessary to be 
able to take color image data from one device and dis- 
play, manipulate, and/or print it on another device 
which may have very different spectral characteris- 
tics. For this reason, it is often necessary to be able 
to take image data in one color space, and convert it 
to a different color space. For example, it may be re- 
quired to take RGB data from an input scanner and 
convert it to a device independent space such as CIE- 
LAB. This device independent data could then be 
used by a variety of different output devices which 
could then convert the data to their own device de- 
pendent color space for display. This permits the va- 
rious devices to be calibrated so that the image will 
have the same color appearance regardless of what 
output device is used. 

The transformation from one color system to an- 
other relates the coordinates in one space to those in 
a different color space. In some cases, this color 
transformation may be as simple as a matrix multipli- 
cation, as in the case of transforming from a video 
RGB space to XYZ. In other cases the transformation 
is more complex, such as when transforming CIELAB 
into CMY(K). 

Atechnique which is used in many applications to 
implement various color space transformations is a 
multi-dimensional color-calibration look-up table. 
This approach has the advantage over other meth- 
ods, such as matrix techniques, that very general col- 
or transformations can be specified. This is particu- 
larly helpful for transforming to hard-copy device col- 
or spaces due to their complex color reproduction 



characteristics. Due to the flexibility of the multi-di- 
mensional look-up table approach, it is also useful for 
implementing many color enhancement schemes, 
and for combining many color transformation steps 
5 into a single step. This approach can be implemented 
in digital hardware and permits fast "computation" of 
the color transformation even when the actual math- 
ematical equations relating the two color spaces are 
very complex. 

10 The basis of the multi-dimensional look-up table 

approach is to store the output color values for a large 
number of combinations of input color values. For ex- 
ample, to convert from a video RGB space to a printer 
CMY(K) space, the desired printer code values could 
15 be stored for every combination of input RGB values. 
However, if each channel of the input RGB space con- 
sisted of 8-bit numbers, this would require storing 
256 3 = 16,777,216 different output color values. For 
an 8-bit CMYK printer 64 MBytes of memory would be 

20 required to store the table. This would be impractical 
for many applications due to the large memory re- 
quirements. In practice, It Is usually necessary to use 
smaller look-up tables. For example, reducing the ta- 
ble size to 1 6 3 will reduce the required memory in the 

25 above example to 16 KBytes. One way to use this 
smaller table is simply to quantize the input color val- 
ues to the nearest look-up table entry. This configur- 
ation is shown in Fig. 1 ., where in a generalized en- 
vironment input color image data exists in some multi- 

30 channel color space, denoted as ABC, where ABC 
may represent RGB, XYZ, CIELAB, CIELUV, 
CMY(K), etc. The color coordinates in this space are 
known with some precision specified by the number 
of digital levels, N 0 . It is desired to convert the color 

35 information for some image into another color space, 
denoted as DEF, with some precision specified by the 
number of digital levels in the output color space (N c 
levels). The color conversion is carried out using a 
group of quantizers 10 which quantize the input color 

40 signals Ao, B G , and C G to N q levels providing the quan- 
tized color signals Aq, B q , and C qt which are used to 
address a multi-dimensional color-calibration look-up 
table 1 2. The number of di mensions for the look-up ta- 
ble 12 corresponds to the number of color parameters 

45 in the input color space. Usually this is three dimen- 
sions, with the exception of CMYK space which would 
have four dimensions. In general, the number of dig- 
ital levels for each channel of the input color space 
may be different, e.g., channel B may have N qB =64 

so levels and channels A and C may have N qAtC =32 lev- 
els. The color-calibration table 12 contains pre-calcu- 
lated output color values for every possible combina- 
tion of quantized input color values. 

The problem that arises in using the approach 

55 shown in Fig. 1 is that many input colors are mapped 
to a single output color. The result will be image arti- 
facts such as contouring where a smooth gradient in 
the input color space gets mapped to a stair-step in 
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the output color space. The visibility of these artifacts 
can be minimized by choosing the optimum quantiza- 
tion levels to store in the look-up table as taught by 
Spaulding, Ray and Sullivan (U. S. Patent Application 
Serial No. 980,860 filed 11/24/92). Although this will s 
minimize the visibility of the quantization artifacts, it 
can not eliminate them altogether when small look-up 
table sizes are used. 

Another method which is sometimes used to 
eliminate the quantization artifacts associated with 10 
small color-calibration look-up table sizes is to use an 
interpolation algorithm to approximate the output col- 
or values for input colors which are intermediate to the 
values that are stored in the table. A variety of inter- 
polation methods can be used including tri-linear in- 15 
terpolation, and tetrahedral interpolation. Although 
this approach can effectively eliminate many of the 
artifacts introduced by the small look-up table size, 
the amount of extra computation associated with the 
interpolation will have a negative impact on the imple- 20 
mentation speed. 

Another approach, to minimizing the appearance 
of artifacts without adding the extra computation as- 
sociated with interpolation is shown in U.S. patent No. 
5,162,925 issued November 10, 1992 to Takaoka et 25 
al. Takaoka et al disclose the use of a form of error dif- 
fusion on the input color signal to distribute truncation 
(a form of linear quantization) errors over a neighbor- 
hood of pixels in a processed image. This approach 
is shown in Fig. 2, where an 8 bit input signal is sup- 30 
plied to a latch circuit 14, which latches the lower or- 
der 2 bits of the picture element data, that is the input 
color image signals. The latched data is multiplied by 
a set of weighting coefficients I to l+n in a set of mul- 
tipliers 15-0 to 15-n and delayed by a set of FIFO 35 
(FIRST IN FIRST OUT) circuits 16-0 to 16-n. The de- 
layed outputs of the FIFO circuits are added to the in- 
put color signal associated with neighboring picture 
elements. in an adder 17. The modified input signal is 
applied to a shift circuit 1 8 to provide a form of linear 40 
quantization. A shortcoming with this process is that 
the local mean of the input signal is not generally pre- 
served in the quantized output signal. Since the local 
mean of the input signal is not preserved in the quan- 
tized output signal, the quantized output signal still 45 
displays contouring artifacts. 

SUMMARY OF THE INVENTION 

The object of the present invention is to provide so 
a method for performing color calibration or a color 
space transformation which reduces the problems 
noted above. 

The object is achieved according to the present 
invention by adding local mean preserving spatial 55 
modulation to the color input signals representing a 
color input image to produce modified color input sig- 
nals; quantizing the modified color input signals to 
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provide color signals having quantization levels cor- 
responding to the values stored in a color-calibration 
look-up table; and retrieving output color signals stor- 
ed in the color-calibration look-up table. "Adding local 
mean preserving spatial modulation" as used herein 
means any technique for adding position dependent 
modulation to an image signal such as dither or error 
diffusion in a manner such that the local mean of the 
input signal is preserved in the quantized output sig- 
nal. 

These and other objects of the present invention 
will become more apparent when taken in conjunction 
with the following description and drawings wherein 
like characters indicate like parts and which drawings 
form a part of the present description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a generic block diagram of a portion 
of a system showing a prior art implementation of a 
multi-dimensional color-calibration look-up table. 

Figure 2 is a block diagram of a portion of a sys- 
tem showing a prior art Implementation for modifying 
the input signal to color calibration look up table. 

Figure 3 is a block diagram of a generalized prior 
art halftoning algorithm useful in describing the pres- 
ent invention. 

Figure 4 is a block diagram of a portion of a sys- 
tem like that shown in Fig. 1 , further including the ad- 
dition of local mean preserving spatial modulation to 
the input color values to reduce contouring in the out- 
put image according to the present invention. 

Figure 5 is a block diagram of a portion of a sys- 
tem like that shown in Fig. 4, where the local mean 
preserving spatial modulation is introduced by adding 
a dither signal. 

Figure 6 is a block diagram of a portion of a sys- 
tem like that shown in Fig. 5, wherein the amplitude 
of the dither signal is scaled by a factor which is a 
function of the input pixel value. 

Figure 7 is a block diagram of a portion of a sys- 
tem like that shown in Fig. 4, where the mean preserv- 
ing spatial modulation is introduced by using a mean 
preserving error diffusion algorithm. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Halftoning is a method which is used in many im- 
age display devices to create the appearance of inter- 
mediate tone (or color) values when only a limited 
number of output display levels are available. For ex- 
ample, if a laser printer can produce only black or 
white regions on the image, it is possible to create the 
appearance of various gray levels by turning on vary- 
ing numbers of image picture elements (pixels) in 
some local image region. This approach relies on the 
fact that the human eye will average over a small area 
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of the image to give the impression of an intermediate 
gray level. When more than two output levels are 
used, it is generally referred to as multilevel halfton- 
ing (see Gentile et al "Quantization and multilevel 
halftoning of color images for near-original image 
quality", Vol. 7, No. 6/June 1990/J. Opt. Soc. Am. A, 
page 1021). Oneway to model halftoning is by the ad- 
dition of a local mean preserving spatial modulation 
to the input signal prior to a quantization step as is 
shown in Fig. 3. Many methods to introduce this spa- 
tial modulation to the input signal have been descri- 
bed in the literature. One common approach is the ad- 
dition of a periodic dither signal. The dither signal is 
typically stored in a dither matrix having values ar- 
ranged in a specified pattern. The range of the values 
stored in the dither matrix in combination with the 
threshold levels in the quantizers are selected so that 
the quantized output signal has the same local mean 
as the input signal. Typical dither matrix patterns in- 
clude random patterns, center-growing dot patterns, 
Bayer dither patterns, blue noise patterns, and mini- 
mum visual noise patterns (see Ulichney, Digital Half- 
toning , MIT Press, Cambridge MA, 1990; U. S. Patent 
No. 5,111,310; U. S. Patent 4,920,501; U.S. Patent 
Application Serial No. 08/131,801, filed Oct 4, 1993, 
entitled "Method and Apparatus for Generating a 
Halftone Pattern for a Multi-Level Output Device", by 
K. Spaulding and L. Ray). Another method which is 
commonly used to add the spatial modulation is 
known as error-diffusion. Error-diffusion works by 
spreading the error made in quantizing one pixel to 
nearby unprocessed image pixels. This will insure 
that the local mean of the tone level will be preserved. 

Our invention involves the combination of local 
mean preserving spatial modulation (multi-level half- 
toning) with a multi-dimensional color-calibration 
look-up table to reduce the visibility of the quantiza- 
tion artifacts associated with the look-up table. Since 
the human eye will average the colors over a small lo- 
cal area of the image, the result will be the creation 
of apparent output color values which are intermedi- 
ate to the output color values stored in the look-up ta- 
ble. This has the advantage over conventional inter- 
polation techniques that the device architecture is 
simpler, and implementation speeds are generally 
faster. 

Referring to Fig. 4, in a generalized environment 
input color image data exists in some multi-channel 
color space, denoted as ABC, where ABC may repre- 
sent RGB, XYZ, CIELAB, CIELUV, CMY(K), etc. The 
color coordinates in this space are known with some 
precision specified by the number of digital levels, N Q . 
It is desired to convert the color information for the im- 
age into another color space, denoted as DEF, with 
some precision specified by the number of digital lev- 
els, N c in the output color space. The color conversion 
is carried out by first applying spatial modulation 40 
to the input color values using an adder 42, to form 
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modified input color values Am, B^, and C m . The am- 
plitude of the spatial modulation should generally be 
related to the size of the quantization intervals asso- 
ciated with the quantizers 44. If quantizers 44 have 

5 non-uniform quantization intervals (such quantizers 
will be call non-linear) it will be desirable to have the 
amplitude of the spatial modulation be a function of 
the input color levels. The spatial modulation can eith- 
er be image-independent, such as when applying a 

10 periodic dither signal, or image-dependent, such as 
when using an error diffusion algorithm. The quantiz- 
ers 44 map the modified input color signals to N q 
quantization levels providing quantized color signals 
Aq, B q , and C q . The quantized color signals are then 

is used to address a multi-dimensional color-calibration 
look-up table 46. In some cases, the number of digital 
levels for each channel of the input color space may 
be different, e.g., channel B may have N qB =64 levels, 
and channels A and C may have N qA(C =32 levels. The 

20 number of dimensions for the look-up table 46 corre- 
sponds to the number of color parameters in the input 
color space. Usually this is three dimensions, with the 
exception of CMYK space which would have four di- 
mensions. The color-calibration look-up table 46 con- 

25 tains pre-calculated output color values for every pos- 
sible combination of quantized input color values. 
This approach can be implemented in digital hard- 
ware and permits fast "computation" of the color 
transformation even when the actual mathematical 

30 equations relating the two color spaces are very com- 
plex. 

Figure 5 shows a specific implementation of this 
invention which uses a local mean preserving dither- 
ing process to introduce the spatial modulation to the 

35 input color values. The dithering is carried out using 
a group of m x by m y dither matrices 50, 51 , and 52 for 
color channels A, B, and C t respectively. The values 
stored in the dither matrices may be comprised in a 
variety of ways such as a Bayer pattern, a center- 

40 grown dot pattern, a random pattern, a blue noise 
pattern, or a minimum visual noise pattern as descri- 
bed above. The dither patterns stored in the dither 
matrices 50, 51, and 52 may all be the same, or they 
may be different. To preserve the local mean of the 

45 input signals, the output of the quantizer for each 
quantization interval should be equal to the mean of 
the input range of the quantization interval minus the 
mean of the values stored in the dither matrix. For this 
example we will assume that the output of the quan- 

50 tizerwill be equal to the mean of the inputrange of the 
quantization interval. This implies that the dither ma- 
trix values should have a mean of zero. The range of 
dither values should equal the input range of the 
quantization interval, so that in this case each dither 

55 matrix contains values uniformly distributed between 
±A/2, where A is the size of the quantization interval 
associated with the quantizers 58. The operation of 
the dithering process will be described for the Achan- 
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nel, the B and C channels being similar. The moduli 
(i.e. the lower order bits) of the x and y address of the 
current pixel location are taken (54, 55) to form ad- 
dresses to the dither matrix. The dither matrix returns 
a dither value in the range ±A/2, which is combined 5 
with the input pixel value using an adder 56 to form a 
modified input pixel value which is applied to the 
quantizer 58. The output of the quantizers 58 in the 
A, B and C channels are used to address the multi- 
dimensional color-calibration look-up table 59, to pro- 10 
duce the color output image in color space DEF. 

Figure 6 shows a specific implementation of this 
invention which uses a non-linear dithering process to 
introduce the spatial modulation to the input color val- 
ues. For this example, non-linear quantizers 68 are 15 
used, and it is therefore desirable to adjust the ampli- 
tude of the dither in each channel proportionally to the 
size of the steps in the quantizers. The non-linear 
dithering is carried in much the same way as with the 
linear case shown in Fig. 5, with the exception that the 20 
dither values are scaled by a factor which is a function 
of the input pixei level. One convenient implementa- 
tion of this scale factor is to form a look-up table 67 
which stores the quantization cell size A for each input 
pixel level. This arrangement is repeated for each col- 25 
orchannel. As in Fig. 5, the moduli (i.e. the lower order 
bits) of the x and y address of the current pixel loca- 
tion are taken (64, 65) to form addresses to the dither 
matrix. The dither matrix values are scaled so that the 
outputs of the dither matrix are in the range ±1/2. The 30 
input pixel value is used to address the quantization 
celt size look-up table 67 that returns the value A rep- 
resenting the size of the quantization step for the cur- 
rent input pixel value. The value A is multiplied by the 
dither value from the dither matrix at the multiplier 63 35 
to produce the non-linear dither value. The non-linear 
dither value is added to the input pixel value at adder 
66, and the sum is applied to the non-linear quantizer 
68. The output of the non-linear quantizers 68 in the 
A, B, and C channels are used to address the multi- 40 
dimensional color-calibration look-up table 69, to pro- 
duce the color output image in color space DEF. 

Non-linear dither could also be implemented us- 
ing the linear dither method shown in Fig. 5 with the 
addition of non-linear look up tables 57 (shown in 45 
Phantom) applied to each channel of the input image 
signal. The non-linear look up tables in combination 
with linear quantizers give the desired non-linear 
quantization. This arrangement has the advantage of 
not requiring the multiply step shown in Fig. 6. so 

Another method for introducing the spatial mod- 
ulation to the input color signals is to use a local mean 
preserving error diffusion algorithm. A block diagram 
showing an implementation of this approach is shown 
in Figure 7. For each input channel, an input pixel val- 55 
ue is quantized by the quantizer 70 to form a quan- 
tized pixel value. A difference signal is calculated 72 
between the quantized pixel value and the input pixel 



value to represent the error introduced by the quan- 
tization process. The difference signal is weighted by 
a series of error weights 74, and is added 76 to the 
input pixel values of nearby image pixels which have 
yet to be processed. As before, the quantized pixel 
values are used to address the multi-dimensional col- 
or-calibration look-up table 78, to produce the color 
output image in color space DEF. The error feedback 
associated with this approach insures that the local 
mean input signal level will be preserved in the quan- 
tized signal. This implementation differs from the pri- 
or art approach shown in Fig. 2 above in that the error 
signal is calculated from the quantized signal rather 
than the input signal. Generally, although there are 
more computations involved than in the dither ap- 
proaches described above, the appearance of the 
spatial modulation introduced by error diffusion will 
be preferable to that obtained with a dither approach. 
Alternatively, if non-linear quantization is used, non- 
linear look up tables 77 may be used (as shown in 
phantom in Fig. 7) to mod if y each channel of the input 
image signal so that simple linear quantizers may be 
used for the quantizers 70. 

While there has been shown what is considered 
to be the preferred embodiments of the invention, it 
will be manifest that many changes and modifica- 
tions may be made therein without departing from the 
essential spirit of the invention. It is intended, there- 
fore, in the annexed claims, to coverall such changes 
and modifications as may fall within the true scope of 
the invention. 



Claims 

1. Apparatus for transforming a digital input color 
image signal expressed in a first color space, into 
a digital output color image signal expressed in a 
second color space, comprising: 

means for receiving the input color image 
signal and applying spatial modulation to each 
channel of the input color image signal to produce 
a modified color image signal; 

a quantizer for each channel of the image 
signal having as input the modified color image 
signal, and producing as output a quantized color 
image signal; 

color-calibration look-up table means con- 
nected to the output of said quantizers for receiv- 
ing quantized color image signals expressed in 
said first color space, and producing output color 
image signals expressed in said second color 
space; and 

said spatial modulation being of a type that 
preserves the local mean of the quantized color 
image signal. 

2. The apparatus in claim 1 wherein said spatial 
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modulation is provided by adding a periodic dither 
pattern to each channel of the input color image 
signal. 

3. The apparatus in claim 2 wherein the amplitude 
of said periodic dither pattern is a function of the 
input color image signal level. 

4. The apparatus in claim 1 wherein said spatial 
modulation is provided by computing a difference 
signal between the input color image signal and 
the quantized color image signal, applying a ser- 
ies of weights to the difference signal to form a 
set of weighted difference signals, and adding 
the weighted difference signals to nearby unpro- 
cessed input image pixels. 

5. The apparatus claimed in claim 1, further com- 
prising: non-linear look-up table means for mod- 
ifying the input color image signal prior to apply- 
ing the spatial modulation to each channel of the 
color image signal. 

6. A method for transforming a digital input color im- 
age signal in a first color space, into a digital out- 
put color image signal expressed in a second col- 
or space, comprising the steps of: 

a. ) applying spatial modulation to each chan- 
nel of the input color image signal to produce 
a modified color image signal, said spatial 
modulation being of the type that preserves 
the local mean of the quantized color image 
signal; 

b. ) quantizing the modified color image sig- 
nals to produce quantized color image sig- 
nals; and 

C;) retrieving output color image signals from 
a color-calibration look-up table as a function 
of the quantized color image signals. 

7. The method in claim 6 wherein saidspatial mod- 
ulation is provided by adding a periodic dither pat- 
tern to each channel of the input color image sig- 
nal. 

8. The method in claim 7 wherein the amplitude of 
said periodic dither pattern is a function of the in- 
put color image signal level. 

9. The method in claim 6 wherein said spatial mod- 
ulation is provided by computing a difference sig- 
nal between the input color image signal and the 
quantized color image signal, applying a series of 
weights to the difference signal to form a set of 
weighted difference signals, and adding the 
weighted difference signals to nearby unpro- 
cessed input image pixels. 



10. 



The method claimed in claim 6, further compris- 
ing the step of modifying the input color image 
signal with a non-linear look-up table prior to the 
step of applying spatial modulation to the input 
color image signal. 
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